Duplicate bibliographic record detection with an OCR-converted source of information
Identifieur interne : 000200 ( Main/Exploration ); précédent : 000199; suivant : 000201Duplicate bibliographic record detection with an OCR-converted source of information
Auteurs : Shoichi Taniguchi [Japon]Source :
- Journal of information science [ 0165-5515 ] ; 2013.
Descripteurs français
- Pascal (Inist)
- Wicri :
- topic : Bibliothèque, Catalogue.
English descriptors
- KwdEn :
Abstract
Duplicate record detection has been an important issue in the fields of data and records management and various detection methods have been proposed. A new method, which uses an optical character recognition (OCR)-converted source of information for record matching to detect duplicates, is proposed and examined in this paper. First, the design of an experiment for examining the perfor- mance of such a duplicate detection method is discussed. The base record set with an OCR-converted title page and its verso were prepared along with two test record sets from different union catalogues, and duplicate records between the base record set and the test sets were manually identified. A duplicate detection system was developed to execute matching (I) between records, (2) between a record and an OCR-converted source of information and (3) using a combination of these. Second, matching performance at the individual data element level is examined. Third, the performance of duplicate record detection based on matching at the element level is examined through rule-based detection and machine learning-based detection. The results of the experiment show the usefulness of incorporating source of information into duplicate detection to a certain extent.
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream PascalFrancis, to step Corpus: 000047
- to stream PascalFrancis, to step Corpus: 000072
- to stream PascalFrancis, to step Curation: 000721
- to stream PascalFrancis, to step Checkpoint: 000043
- to stream Main, to step Merge: 000203
- to stream Main, to step Curation: 000200
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" level="a">Duplicate bibliographic record detection with an OCR-converted source of information</title><author><name sortKey="Taniguchi, Shoichi" sort="Taniguchi, Shoichi" uniqKey="Taniguchi S" first="Shoichi" last="Taniguchi">Shoichi Taniguchi</name><affiliation wicri:level="1"><inist:fA14 i1="01"><s1>School of Library and Information Science, Keio University</s1><s3>JPN</s3><sZ>1 aut.</sZ></inist:fA14><country>Japon</country><wicri:noRegion>School of Library and Information Science, Keio University</wicri:noRegion></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">INIST</idno><idno type="inist">13-0299709</idno><date when="2013">2013</date><idno type="stanalyst">PASCAL 13-0299709 INIST</idno><idno type="RBID">Pascal:13-0299709</idno><idno type="wicri:Area/PascalFrancis/Corpus">000047</idno><idno type="stanalyst">FRANCIS 13-0299709 INIST</idno><idno type="wicri:Area/PascalFrancis/Corpus">000072</idno><idno type="wicri:Area/PascalFrancis/Curation">000721</idno><idno type="wicri:Area/PascalFrancis/Checkpoint">000043</idno><idno type="wicri:doubleKey">0165-5515:2013:Taniguchi S:duplicate:bibliographic:record</idno><idno type="wicri:Area/Main/Merge">000203</idno><idno type="wicri:Area/Main/Curation">000200</idno><idno type="wicri:Area/Main/Exploration">000200</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a">Duplicate bibliographic record detection with an OCR-converted source of information</title><author><name sortKey="Taniguchi, Shoichi" sort="Taniguchi, Shoichi" uniqKey="Taniguchi S" first="Shoichi" last="Taniguchi">Shoichi Taniguchi</name><affiliation wicri:level="1"><inist:fA14 i1="01"><s1>School of Library and Information Science, Keio University</s1><s3>JPN</s3><sZ>1 aut.</sZ></inist:fA14><country>Japon</country><wicri:noRegion>School of Library and Information Science, Keio University</wicri:noRegion></affiliation></author></analytic><series><title level="j" type="main">Journal of information science</title><title level="j" type="abbreviated">J. inf. sci.</title><idno type="ISSN">0165-5515</idno><imprint><date when="2013">2013</date></imprint></series></biblStruct></sourceDesc><seriesStmt><title level="j" type="main">Journal of information science</title><title level="j" type="abbreviated">J. inf. sci.</title><idno type="ISSN">0165-5515</idno></seriesStmt></fileDesc><profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Bibliographic reference</term><term>Catalogs</term><term>Detection</term><term>Information source</term><term>Library</term><term>Optical character recognition</term><term>Title</term></keywords><keywords scheme="Pascal" xml:lang="fr"><term>Référence bibliographique</term><term>Détection</term><term>Reconnaissance optique caractère</term><term>Source information</term><term>Bibliothèque</term><term>Catalogue</term><term>Titre</term></keywords><keywords scheme="Wicri" type="topic" xml:lang="fr"><term>Bibliothèque</term><term>Catalogue</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Duplicate record detection has been an important issue in the fields of data and records management and various detection methods have been proposed. A new method, which uses an optical character recognition (OCR)-converted source of information for record matching to detect duplicates, is proposed and examined in this paper. First, the design of an experiment for examining the perfor- mance of such a duplicate detection method is discussed. The base record set with an OCR-converted title page and its verso were prepared along with two test record sets from different union catalogues, and duplicate records between the base record set and the test sets were manually identified. A duplicate detection system was developed to execute matching (I) between records, (2) between a record and an OCR-converted source of information and (3) using a combination of these. Second, matching performance at the individual data element level is examined. Third, the performance of duplicate record detection based on matching at the element level is examined through rule-based detection and machine learning-based detection. The results of the experiment show the usefulness of incorporating source of information into duplicate detection to a certain extent.</div></front></TEI><affiliations><list><country><li>Japon</li></country></list><tree><country name="Japon"><noRegion><name sortKey="Taniguchi, Shoichi" sort="Taniguchi, Shoichi" uniqKey="Taniguchi S" first="Shoichi" last="Taniguchi">Shoichi Taniguchi</name></noRegion></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000200 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000200 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= OcrV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= Pascal:13-0299709
|texte= Duplicate bibliographic record detection with an OCR-converted source of information
}}
| This area was generated with Dilib version V0.6.32. |  |